The Automat

Field notes from the bleeding edge of business

No Featured Post Selected

The Latest...

Context Windows Got Huge. Here's Why Your Agent Still Forgets

Context Windows Got Huge. Here's Why Your Agent Still Forgets

Context Windows Got Huge. Here's Why Your Agent Still ForgetsDrew Donaldson
Published on: 05/08/2026

Long context windows limitations, explained: why million-token models still forget, how context rot bites, and when retrieval beats a bigger window.

LLM Newslong context windows limitations2026AI operatorslost in the middle